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ABSTRACT 



A method and apparatus for coding and decoding a sequence 
of data packets with use of a novel class of forward error 
correcting codes having coding rates greater than 1/2 which 
nonetheless provide relatively high levels of channel pro- 
tection against burst erasures with a relatively low decoding 
delay. In accordance with certain illustrative encoder 
embodiments of the present invention, the source informa- 
tion contained in each of a plurality of packets to be coded 
is similarly divided into a plurality of (similar) correspond- 
ing portions, and "checksums" are computed over multiple 
data packets, each such checksum being based on different 
(i.e., non-corresponding) portions of at least two of the 
multiple packets. These "checksums" are then advanta- 
geously appended to various subsequent data packets to be 
coded. By using different portions of multiple packets from 
which the checksums are computed, forward error correct- 
ing codes having rates greater than 1/2 which provide high 
levels of channel protection against burst erasures with 
relatively low decoding delays are advantageously provided. 
In accordance with illustrative decoder embodiments of the 
present invention, erased data packets may be regenerated 
based on the decoding of one or more subsequent (correctly 
received) data packets which include such appended "check- 
sum" data. 

20 Claims, 4 Drawing Sheets 
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LOW DELAY CHANNEL CODES FOR 
CORRECTING BURSTS OF LOST PACKETS 

HELD OF THE IISTVENTION 5 

The present invention relates generally to the field of error 
correcting codes for data transmission and more particularly 
to a packet loss recovery technique for use in data packet - 
based networks providing real-time multimedia communi- 
cations. 

BACKGROUND OF THE INVENTION 

One of the most significant issues that must be dealt with 
in data packet-based communications networks such as, for 
example, the Internet, is the problem of error correction due 
to packet loss. Since each data packet is transmitted through 
the network independently (and potentially via entirely 
different network routes), it is common for a destination 
location to fail to receive an occasional sequence of one or 20 
more data packets, and to receive some such packets after an 
a typically substantial delay. And when such a network is 
employed to provide real-time multimedia communications 
such as, for example, voice communications, receiving some 
data packets after a substantial delay may be tantamount to 25 
not receiving them at all, since the receiver cannot typically 
wait to proceed with the processing of subsequent data 
packets. 

A number of techniques, invariably involving some sort 
of redundancy coding, have been employed to address the 30 
general problem of error correction including the packet loss 
problem. Typically, the packet loss channel is recognized as 
an erasure channel using a channel coding language. Clas- 
sical error correcting codes such as binary block codes, 
convolutional codes, and Reed Solomon codes, each famil- 35 
iar to those of ordinary skill in the art, can then be employed 
in an erasure correcting mode. (See, e.g., E. Ayanoglu et al., 
"Diversity Coding for Transparent Self-HeaUng and Fault- 
Tolerant Communication Networks," IEEE Transactions on 
Communications, vol. 41, no. 11, pp. 1677-1685, 40 
November, 1993; and R. Urbanke et al., "Methods and 
Apparatus for Packetizing Data for Transmission Through 
an Erasure Broadcast Channel," co-pending U.S. patent 
application, Ser. No. 08/892,855, filed Jul 15, 1997 and 
assigned to the assignee of the present invention, U.S. patent 45 
application, Ser. No. 08/892,855, now U.S. Pat. No. 6,175, 
944, is hereby incorporated by reference as is fully set forth 
herein.) However, it is in fact considerably simpler to correct 
an erasure than to correct other types of errors (such as, for 
example, "random" modifications of one or more symbols). 50 
In the case of an error, the location of the error must first be 
determined, while in the case of an erasure (e.g., an unre- 
ceived data packet), the location is known. 

Typically, a random error correcting code can correct 
about twice as many erasures as errors in a given block. 55 
However, in the context of a transmission of a sequence of 
data packets across a network, a packet loss effectively 
causes a continuous siring (a "burst") of erased symbols. 
Since most classical channel codes are designed for the 
correction of random errors (or random erasures), prior art 60 
approaches to dealing with the packet loss problem typically 
perform some form of interleaving (permuting) on a rela- 
tively long sequence of packets. In this manner, a packet loss 
channel with correlated erasures (i.e., a continuous string of 
erased symbols) is transformed into an apparently random 65 
erasure channel. Unfortunately, performing such an inter- 
leaving process necessarily results in a significant delay at 
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the destination, since the decoder must de-interleave the 
received data in order to recreate the original sequence of 
data packets. 

Therefore, the use of channel codes such as, for example, 
Reed Solomon codes, when effectively applied across many 
packets in sequence, will necessarily require that relatively 
long delays be incurred at the receiver. As pointed out above, 
however, such delays may be prohibitive for real-lime 
applications such as, for example, voice communication 
over networks based on the Inlerael protocol (IP). Recently, 
however, in U.S. Pat. No. 5,870,412 ("Forward Enor Cor- 
rection System for Packet Based Real Time Media") issued 
to G. M. Schuster et al. on Feb. 9, 1999 (hereinailer, 
"Schuster et al."), a method for data recovery in a bursty 
packet network which incurs a relatively short delay (as 
compared to other prior art techniques) has been presented. 

Specifically, Shuster et al. performs forward error correc- 
tion by appending checksum information to, each data 
packet, wherein the checksum information is defined by 
taking a bit-by-bit exclusive-or sum of the information 
portion (the "payload") from a preceding specified number 
of data packets. (Bit padding on the shorter payloads is used 
if the information payloads from the preceding packets are 
of unequal length.) By way of illustration, FIG. 1 shows an 
organization of an encoded data packet in accordance with 
the prior art packet loss recovery techniques as employed in 
Shuster et al. The illustrated data packet comprises coded 
information followed by checksum information which has 
been appended to the data packet for purposes of forward 
error correction. As described above, in the case of the 
Shuster et al. technique, the checksum information specifi- 
cally comprises an exclusive-or sum of the information 
payload from a preceding specified plural number of data 
packets. 

Thus, using the Shuster et al. technique, a single bit 
erasure correction code of length w+1 packet instances is 
formed, enabling for the correction of a burst of up to w lost 
data packets (provided such a burst is followed by a string 
of w correctly received data packets), with a maximum 
decoding delay of 2w-l packets. Clearly, the Shuster et al. 
method incurs an overhead in bit volume of at least 100% 
(more if bit padding is required), as compared to the bits of 
the information payloads alone. In addition, it can be seen 
that the method of Shuster et al, requires the solution of w 
exclusive-or equations. 

In co-pending U.S. patent application Ser. No. 09/425, 
143, "Packet Loss Control Method For Real-Time Multi- 
media Communications" by H-L. Lou and C-E. W. 
Sundberg, filed on Oct. 21, 1999 and commonly assigned to 
the assignee of the present invention (hereinafter, "Lou et 
al,"), a significantly improved technique over that of Shuster 
et al. was provided. U.S. patent application Ser. No. 09/425, 
143 is hereby incorporated by reference as if fully set forth 
herein. By way of illustration, FIG. 2 shows an organization 
of an encoded data packet in accordance with the prior art 
packet loss recovery techniques as employed in Lou ct al. 

In particular, while Shuster et al. generates checksum 
information by "combining" (e.g., by performing exclusive- 
or operations on) the payload information from a plurality of 
preceding data packets, Lou et al. simply "repeals" infor- 
mation conlent from a particular one of the previous data 
packets in a later packet. More specifically, according to the 
technique of Lou et al , the information payload associated 
with a given data packet k, for example, might be identically 
copied and appended to data packet k+w. filial is, the 
information payload would be repealed with a delay of w 
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transmitted packets.) Such an improved approach advanta- a plurality of said data packets, said coding of each of said 

geously can correct for a burst of up to w lost data packets data packets comprising coding said set of payload infor- 

(as does the method of Shuster et al.) while improving the mation comprised therein by coding at least one of said 

decoding delay to w packets as compared to the 2w-l plurality of individual payload information portions thereof; 

decoding delay required by the method of Shuster ct al. In 5 and coding an additional one of said data packets, said 

fact, it can be shown that the decoding delay required by the additional data packet being subsequent in said sequence to 

technique of Lou et al., relative to the number of consecutive each of said plurality of data packets, said plurality of data 

lost packets that can be properly corrected, is in fact optimal. packets thereby being previous to said additional data 

(Note that each of these prior art approaches append forward packet, said coding of said additional data packet compris- 

error correcting data to the existing packets without adding lo ing coding said set of payload information comprised 

any additional packets.) therein, said coded additional data packet further comprising 

Both of the above-described prior art approaches (i.e., an added set of payload information which provides forward 

those of both Shuster etal. and the improved method of Lou error correcting capability for said payload information 

et al.), however, are limited to providing rate 1/2 convolu- comprised in said plurality of previous data packets, wherein 

tional forward error correcting codes (FEC). (As is fully is said added set of payload information comprised in said 

familiar to those of ordinary skill in the art, the "rate" of an coded additional data packet is based on a combination of 

error correcting code is determined based on the ratio said payload information comprised in two or more of said 

between the total number of bits used to encode a given set previous data packets, and wherein said payload information 

of data being encoded, and the number of "information" bits comprised in at least two of said previous data packets upon 

which are being encoded therefrom.) Often, however, it is 20 which said added set of payload information is based 

desirable to employ error correcting codes with rates which comprises payload information from different individual 

arc greater than 1/2 for purposes of increased transmission payload information portions thereof. 

efiBciency. Therefore, it would be highly desirable to devise In addition, in accordance with the present invention, a 

forward error correcting channel coding techniques having method and apparatus for decoding a coded sequence of data 

rates greater than 1/2, which, like the rate 1/2 technique of 25 packets in response to an erasure of one or more of said data 

Lou et al, advantageously provide relatively high levels of packets in said sequence is provided, wherein said sequence 

channel protection against burst erasures with a relatively (if of data packets has been coded with use of the above 

not optimally) low decoding delay, while still maintaining described coding technique, and wherein the method or 

the existing number of transmitted packets and the existing apparatus comprises steps or means for decoding said coded 

packet structure. 30 additional one of said data packets, said additional one of 

SUMMARY OF THE INVENTION ^^^^ ^^"^^^^ ^'"^ subsequent in said sequence to at 

NUMMARY Uh int. ifNVtiiNiiuiN least one of said erased data packets, to generate at least one 

In accordancewith the principles of the present invention, of said individual payload information portions thereof 

a novel class of forward error correcting codes having representative of said forward error correcting data; and 

coding rates greater than 1/2 are provided which provide 35 reproducing said at least one of said erased data packets 

high levels of channel protection against burst erasures with based on at least said generated individual payload infor- 

a relatively low decoding delay. In particular, a novel nation portion of said decoded additional one of said data 

method of channel coding, in accordance with certain illus- packets, 
trative embodiments of the present invention comprises 

similarly dividing the source information (i.e.. the data) 40 BRIEF DESCRIPTION OF THE DRAWINGS 

contained in each packet to be coded into a plurality of FIG. 1 shows an organization of a sequence of encoded 

(similar) corresponding portions, and then computing data packets which have been coded in accordance with a 

"checksums'* over multiple data packets, each such check- certain first prior art packet loss recovery technique, 

sum being based on different (i.e., non-corresponding) por- piG. 2 shows an organization of a sequence of encoded 

tions of at least two of the multiple packets. These "check- 45 data packets which have been coded in accordance with a 

sums" are then advantageously appended lo various certain second prior art packet loss recovery technique, 

subsequent data packets to be coded (as in the above- pjc. 3 shows an illustrative zero state response of a code 

described prior art techniques). However, by using different constructed in accordance with a first illustrative cmbodi- 

portions of multiple packets from which the checksums are Qj^Qt Qf jjjg present invention. 

computed, forward error correcting codes having rates 50 piG. 4 shows an organization of a sequence of encoded 

greater than 1/2 which nonetheless provide relatively high ^^^^ p^ckGis which have been coded in accordance with a 

levels of channel protection against burst erasures with illustrative embodiment of the present invention, 

relatively low decoding delays are advantageously provided. 5 ^^^^^ organization of a sequence of encoded 

In accordance with illustrative decoder embodiments of the ^^^^ ^^^^^ ^^.^^ ^^^^ ^^^^ ^^^^^ accordance with a 

present invention erased data packets may be regenerated 55 3^^^^ iUustrative embodiment of the present invention, 

based on the decoding of one or more subsequent (correctly , , r e 

..... , , u- u • 1 J u J j«u 1 FIG. 6 shows an organization of a sequence of encoded 

received) data packets which include such appended "check- . uuu u ^j- -1 *u 

sum" data packets which have been coded in accordance with a 

sum aa. ... third illustrative embodiment of the present invention. 

More specifically, in accordance with the present ™^ _ . i- j • c - . c 

^ J r J- f J . 1 « FIG. 7 shows a generalized view of an organization of a 

mvention, a method of codmg a sequence of data packets 60 - j j j « \ * u- uu u j j • 

^ c - c » • • J J sequence of encoded data packets which have been coded in 

representing a continuous stream of information IS provided, ^ . ... t 1 c n . u a- 

i . . .r i j r accordance with one general class of illustrative cmbodi- 

wherein each data packet comprises a set of payload mfor- . r .u . • 

. r . f -J / c • c ments of the present mvention. 

mation representative of a segment of said stream of mfor- *^ 

mation corresponding thereto, each set of payload informa- DETAILED DESCRIPTION 

lion having been similarly divided into a plurality of 65 Notation 

corresponding individual payload information portions, the For any symbol s, define ^ as the string obtained by 

method or apparatus comprising steps or means for coding repeating s exactly x times (e.g., {00}^- {0000}). We denote 



03/10/2004, EAST version: 1.4.1 



us 6,694,478 Bl 

5 6 

the concatenalion of two strings, a and b as aOb (e.g., d„{(i0)+iQi)iDU0i)+0i)D}-2 

{01} 0 {11}-{0111}). We use Tk . • . ,eo,e„e2, . . . ) to but 
denote an erasure sequence where e^.«l if and only if the i*th 

symbol is erased. In general, for any vector 7, we use 5 ^„{(iHO)/>.(0)Z)^.Ci)z>^. (0Hi)X).(i)o^^(i)O^}-3. 

subscripts and superscripts together to denote the sub-vector j^^^-^^ ^^^^^-^ Techniques in Relation to 

from component 1 to component j as m e, =(e,, ^^^^^^ Advantageous Criteria 

e,.:, . . . ,e,-„eO. We will use the wild character, * to ^^^^ ^^^^ ^ j^^g^ ^j^^^ ^^^^^^-^^ ^^^^^^^^ ^^-^^ 

indicate that a particular symbol may be arbitrary (e.g., q^aUfy as burst erasure channels and various metrics may be 

T«(l*l) refers to both (101) and (111)). We will use the appropriate to characterize the quality of a given forward 

notation "D" to indicate that a particular symbol may be error correcting code for a general channel. As one generally 

*u- u * n / 1^ u ^ u,.. useful criteria, however, it is often advantageous to evaluate 

anything but 0 (e.g., x K102) could be (112) or (122) but . , , • .u i 

^.r^^r. V B . -V / \ / \ / an error correcting code by me asunng the longest erasure 

^ . c J burst that can be corrected by the given code for a given 
A sequence of erasures, e, „ e, 2, • • ; . e,^, is referred 35 ^elay and guard space. Thus, in accordance with the prin- 

to as an "erasure burst of length s relative to a guard ^.^^^^ ^^^^^^ invention, we expressly define our 

space of length g if: "goal" to be that of reliably transmitting information over a 

1. ei+i=ei+,«l burst erasure channel (i.e., a channel which tends to expe- 

2. The g symbols preceding c^^^ and the g symbols rience multiple consecutive erasures) with a fixed (and 
following e^^j are all 0*s. preferably minimal) decoding delay constraint. 

3. The s symbols from e^,, through e, , contain no ^IG. 1 shows an organization of a sequence of encoded 
subsequence of g O's, ^^^^ packets which have been coded in accordance with the 

_> prior art packet loss recovery technique described in Shuster 

We will use x [i] to refer to information sequences and ^ ai. The specific technique described therein is designed to 

7[i] to refer to the corresponding encoded sequences. Let correct erasure bursts of length 3 (for example) with a rate 

_ .... J 1/2 systematic error correcting code. Clearly, to use a rate 

X [1] denote the information sent m symbol 1. In accordance ^^^^ maintain the same information rate, the packet 

with certain illustrative embodiments of the present ^^^^^^^ ^^^^ ^^^^^^^ information bits are 

mvention, m order to achieve a rate^kin error correctmg g^^p^^ -^j^ symbols, x[i], occupying the "left" (i.e., the 

code, we will advantageously divide x [i] into k equal units: first) half of the packet payload and the parity check bits are 

7ril-fx Til X fil xJil^ Each unit is an element of g^o^P^d into symbols occupying the "right" (i.e., the 

^wii-: ' i jj I-' * J w 1- ^ f second) half of the packet payload. As can be seen, for 

GF(20 with addition, 0, and multiplication, x, of units / ^ ™„ . , . , , 

\ :^ ■,. . . J J 1 f c c ij example, from FIG. 1, the rule to create the i th coded packet 

earned out according to the standard rules of finite field ^ ^ -.u *u . u • t cu . . i ■ 

. - „ - ,Y. . r jt- 1 11 • i_ . in accordance with the technique of Shuster el al. is: 

arithmetic, fiilly familiar to those of ordinary skill m the art. 35 ^ 

We shall use D to denote the delay operator. Thus an ydtM'] 
information sequence consisting of 2 non-zero symbols at 

time 0 and time 1 with all other symbols being 0 may be yJ(l-4'-3]©4*-21©Act/-i] 

written as; _^ 

40 As can also be seen from the figure, if packets y [i+1], 

7iDHxd0M0\ xiODWU M21 . . . , xAODD and 7[i+3] are lost due to a burst of length 3. the 

corresponding information symbols can be recovered once 

Similarly, the coded sequence for a corresponding repetition _^ _^ _^ 

code may be written as: y y [i+5], and y [i+6] are received by solving the 

45 parity check equations as shown below: 

7(z?)-(ir[oi7[-iKir[iL 7mD+7[2i Tfip^ 

4/ + 5] = y,t/ + 5] 

As is customary, we will use [a J to denote the integer part 4* + 4] = yi[/ + 4] 

of the real number a (for example, [3/2j«l), and we will use x[i + 3] = jvi [/ + 6] ©jf[/ + 5] ©4^ + 4] 

[a] to denote the next integer greater than or equal to the real + 2] = yi [/ + 5] ©jr[i + 4] ex[i + 3] 

number a (for example, f3/2l«2). x[i + i] = ydi + 4]®x[i+3]®x[i + 2] 

We will use d^,{?,,T2} to refer to the Hamming distance 

(familiar to those skilled in the art) between two symbols c 1 Thus x[i+l] may be recovered once 7p+6] has been 

and T2. SpecificaUy, d^j^^T^loQ if and only if and received, thereby resulting in a decoding delay of 5. 



c 2 are identical and 1 otherwise. We will use the same 



FIG. 2 shows an organization of a sequence of encoded 
data packets which have been coded in accordance with the 



notation to refer to the Hamming distance between prior art packet loss recovery technique disclosed in Lou et 
sequences. The Hamming distance between two sequences ^1. In particular, Lou el al. proposes a code referred to as the 
is defined as the sum of the distances between the symbols; 60 "(jupHcaie and delay" code. Note specifically that if packets 

^ y[i+l], y[i+2], and y [i+3] are lost due to an erasure burst 

dH{?iDhc2m2^dH(^dtlc2m of length 3, the corresponding information symbols can be 

recovered once y [i+4], y [i+5], and y [i+6] are received, 
since 

Note that the symbol size is relevant in evaluatmg the 
distance. For example, j4*+iHiI'+4J x[i+2}-yi[i+5] jc(/+3]-yi[i+6). 
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Note that x[i+j] is recovered from yi[i+j+3] for j€{l^,3}. a stream of input symbols instead of just an input at time 0. 

Thus, the decoding delay of the technique of Lou et al. is For example, consider a rate 2/3 parity check code in 

advantageously only 3, as opposed to the decoding delay of accordance with a first illustrative embodiment of the 

5 required for the technique disclosed in Shuster et al. present invention. Specifically, this illustrative code, which 

Therefore, it can be seen that the simple duplicate and delay 5 will be referred to as MS(l,l), is defined as having the 

code is "superior" (in terms of our adopted criteria or "goal") following ZSRq: 
to the code disclosed in Shuster ct al. — whereas both codes 

can correct a burst of 3 erasures, the duplicate and delay 7p)-(401jcx10J>0)+(0. xJi^WHO, o, x^[oj), 

code has a shorter decoding delay. 

An Overview of a Class of Illustrative Embodiments of the lo FIG. 3 shows an illustrative zero state response of a code 

Present Invention constructed in accordance with this first illustrative embodi- 

In accordance with the principles of the present invention, ment of the present invention. In particular, the ZSR for a 

a technique which provides for the construction of a class of stream of information symbols starting at time 0 is shown in 

systematic, linear, time-invariant, convolutional codes ^^e figure. 

which are advantageously "maximally short" is described 15 F^G- shows an organization of a sequence of encoded 

herein. We call these codes "maximally short" (MS) because data packets which have been coded in accordance with the 
they advantageously have the shortest possible decoding illustrative embodiment of the present invention, as 

delay and the shortest possible guard length for a given specifically defined in terms of the ZSR shown in FIG. 3. 

erasure burst length. Although this technique provides for a From FIG. 4 it can be seen that this illustrative MS(1,1) code 

class of codes having various coding rates greater than 1/2, 20 can advantageously correct an erasure burst of length 1 with 

in order to introduce some further notation and to illustrate a guard space of 2 and a decoding delay of 2. Consider, for 

certain key ideas, a pair of 2/3 rate codes in accordance with example, the situation explicitly shown in the figure where 

first and second illustrative embodiments of the present the coded symbol 7[3] is erased. To recover Xo[3] the 

invention, as well as a rate 3/5 code in accordance with a decoder advantageously waits until 
third illustrative embodiment of the present invention, will 25 

be presented in detail herein before the general class of Tl^X^ol^J ^il^l Jtol3]©>^i[2D 

illustrative codes is described. 

In particular, we will describe how to advantageously is received, and it then recovers Xo[3] using Xo[3]«y3[4]0 

construct MS codes for all rates of the form R=(ms+l)/(ms+ (_^^2]). Similarly, x J3] is recovered from 7[5] using 

1+s), where m and s are arbitrary positive integers. We will 30 ^ rj!; ^ r5iffif_x UT) 

refer to the rate (ms+l)/(ms+Us) code as MS(m,s) It can be ^^^l^^ the deeding delay required for this first iUustra- 

shown that these codes are advantageously capable of cor- ^.^^ embodiment of the present invention is T=2. The guard 

recting erasure bursts of length s with a guard length (g) and ^^^^ ^^^^^^ ^ ^^^^^ ^^^^ decoding "rule" only 

a decodmg delay (T) as follows: ^^^-^^ ^^^^^ ^^^^ 2 symbols after the erasure and the 1 

yr-ms+i. symbol preceding the erasure are unerased. Note that it can 



In accordance with certain illustrative embodiments of the 



easily be shown that the illustrative MS(1,1) code is advan- 
,. , . , .... tageously "optimal" in terms of these adopted criteria, 

present invention, we also disclose a simple periodic mter- ^ interleaved Rate 2/3 Code in Accordance with a Second 
leaving technique which corresponds to sampling by a given mustrative Embodiment 

factor, k. 11 can be shown that by interleaving m the 40 Admittedly, a code which corrects only 1 erasure does not 
proposed manner, an MS(m,s) code developed in ac<»r- ^^^^ .^^^.^^^ meaDing of a "burst erasure" correction 
dance with the prmciples descnbed herein, which ^ capable Hov^cwcr, by using degree X periodic interleaving, an 

of correctmg erasure bursts of length s with guard length g ^ ^^^^^^ ^^^^ correcting code having guard length and 
and decoding delay i may be advantageously transrormea ^ j respectively, and derived in accor- 

mto a related code which is capable of correctmg erasure 45 ^^^^^ principles of the present invention, may be 

bursts of length Xs with a corresponding guard length of Xg advantageously transformed into a }^ erasure burst correct- 
and a decodmg delay of XT. • ^^^^ j^^^ • ^.^ ^^^^^ decoding delay Xg and XT, 

The Illustrative construction m accordance with the ti^^ly. Specifically, such an interleaving process, 

present disclosure advantageously makes extensive use of ^^[^j^ advantageously used in accordance with a 

systematic, hnear, maximum distance separable (MDS) 50 second illustrative embodiment of the present invention, is 
block codes. MDS codes, which are fully familiar to those ^ upsampling. In particular, given a code with ZSRo 

of ordinary skill m the art, are useful building blocks ^ r j r r o r o -u 

because MDS codes with useful properties can be con- y (D), the X-upsampled "version" of the given code has 
slructed as Reed-Solomon codes. (Reed-Solomon codes are ^SR^ '>^(D^). 

also fully familiar to those of ordinary skill in the art.) 55 pj^ 5 ^^^^^ organization of a sequence of encoded 
Specifically, it is well known that Imear, systematic. Reed- ^ata packets which have been coded in accordance with a 
Solomon codes can be constructed for all values of (n, k, ^^^^j illustrative embodiment of the present invention in 
don-k+1) using q-ary symbols over GF(q=2'). ^tiich the MS(1,1) code (i.e., the rate 2/3 code of the first 

A Rate 2/3 Code in Accordance with a First lUustrativc illustrative embodiment of the present invention) has been 
Embodiment 60 upsampled by X«2 to obtain ZSRq 

When considering linear, time-invariant convolutional 
codes, a useful tool is the zero state response (ZSR), fiilly lio^ix^o] Jt[oi o)(o, OrJOBor 

familiar to those of ordinary skill in the art, which is the 

output of an encoder that starts in the all 0 state. We can Note that in accordance with this second illustrative 
completely specify a code using the zero state response lo an 65 embodiment of the present invention, if a burst of 2 erasures 
input which is non-zero only al time 0 (ZSRq). However, it starts at, for example, time 1=4, then the erased symbols can 
is usually easier to analyze a code by writing out the 2^R for be recovered in a manner similar to that described above in 
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connection with the first illustrative embodiment of the recover Xo[3] and Xo[4] from y3,4[5]=P{Xo[4], Xo[3], Xj[2], 

present invention (i.e., the non-upsampled rate 2/3 code). XJ2]}. Since C has minimum distance 3 and (illustratively) 

Note also that the decoding delay and guard length required we have assumed herein that neither Xjl2] nor XJ2] were 

for the upsampled code are clearly twice that required for the erased, Xo[3] and Xo[4] can be successfully recovered. Next, 

"base" code. Thus, the upsampled code in accordance with 5 . , , . -♦r^-i . . 

the second illustrative embodiment is a rate 2/3 code with the decoder receives y [6] and then advantageous y uses it 

g/soT/s«4/2«2, which is also advantageously "optimal" in ^^^^de x^^JS] from y3.4[6]=P{xo[5], Xo[4], x,[3], xJS]}. 

terms of the adopted criteria. Since Xo[4] was recovered at the previous step and since 

It will be obvious to those of ordinary skill in the art that, Xo[5] was uncreased, x^ JS] can be successfuUy recovered, 

in general, MS(m,l) codes of rate R«(m+l)/{m+2} can be lo Finally, when the decoder receives y3,i7]=P{xj:6], x^5l 

advantageously constructed in accordance with the prin- ^^[4], xji4]}, it can advantageously recover x^^j^A], since 

ciples of the present invention for any value of m^l using Xo[5] and Xo[6] were also (illustratively) unerased, 

single parity check codes similar to the one described above By inspecting FIG. 6 it can be easily seen that for an 

in the discussion of the first illustrative embodiment of the erasure burst of length 2 starting at time t, the illustrative 

present invention (i.e., the rate 2/3 code). It will also be 15 decoding rule as described herein requires that symbols t+2, 

obvious to those skilled in the art that these codes will have t+3, and t-1 be unerased. Therefore the guard space required 

decoding delay T=m+1, and will require a guard space of is clearly g=2. Similarly, it can be seen that the decoding 

g=m+l. Such codes advantageously meet the "optimality" delay will also be T«2. These values meet the "optimality" 

criteria discussed above and adopted herein. Moreover, and criteria as described above (and therefore the illustrative 

also in accordance with the principles of the present 20 MS(1,2) code as described is, in fact, "maximally short"), 

invention, these codes may be advantageously upsampled by in accordance with another illustrative embodiment of the 

any multiple X=s in order to produce codes which correct present invention, the MS(1,2) code can be advantageously 

erasure bursts of length s for any s^l. Clearly, these codes upsampled in an analogous manner to the upsampling of the 

also advantageously meet the "optimahty" criteria discussed MS(1,1) performed in accordance with the second iilustra- 

above and adopted herein. 25 tive embodiment of the present invention. In particular, the 

A Rate 3/5 Code in Accordance with a lliird Illustrative MS(1,2) may be upsampled by X to obtain a rate 3/5 code . 

Embodiment which corrects erasure bursts of length sX relative to a guard 

Note that the MS(1,1) code as defined above in accor- space of gX and with a decoding delay of TX, (Note that 

dance with the first illustrative embodiment of the present again, since the "base" code is maximally short, the 

invention is based upon a (3,2) single parity check (SPC) 30 upsampled codes will also advantageously be maximally 

block code, which is fully familiar to those of ordinary skill short.) 

in the art Note also, however, with reference for example to ^ Generalized Class of lUustrative Embodiments of the 

FIG. 4, that the parity check symbols are not computed on Present Invention 

"rows" or "columns," of symbols, but rather, are advanta- _ . i • c ■ e 

geously computed on "diagonals" of symbols. To generalize 35 ^ ^^ows a generalized view of an orgamzation of a 

The MS(1,1) code lo coding rates other than 2/3 in such a of encoded data packete which have been coded m 

way so as to maintain its desirable performance accordance with one general class of il ustrat.ve embodi- 

characteristics, we advantageously maintain the idea of mentsof the presen invent.on. In particuhr, a ^ 

using block codes computed across packets, but move to constructing general MS(m,s) codes for all mSl and all s^ l 

. ,. , *^ /fc4i^c\ui 1 m accordance With the prmciples of the present invention IS 

usme maximum distance separable (MDS) block codes (also 40 ^ ^ K , ■ , r 

cue i- . .u e A- 1 11 • ■ «f described below. Based on such a construction, a class of 

fully famiuar to those of ordinary skill m the art) instead 01 , , , , . ,. 

• cnr- ui I ™j o « 1^. r» u« « ^t.v, illustrative encoder and decoder embodiments of the present 

usme SPC block codes. Specincally, let C be a systematic, . . . , 

/ I j\ //: .4 ox ui 1 A /Kr . *u « w'li u« fi.ii,. mventiou may be advantageously derived. It is to be noted 

(n, k, d)«(o,4,3) block code. (Note that it will be fully , , , . ^ t , . 

famiUar to those skiUed in the art that a (6,43) MDS code *V ^^^2/ '^^ I n 

can be constructed by first constructing an (8,4^) systematic 45 h^se generalized MS(m,s codes (as weU as aU upsampled 

Reed-Solomon code over GF(2') and then puncturing the ""l »" njax'-na^ly short and thereby 

last two parity check symbols.) wi denote the 2 parity check °?^'°^\ ° V ? . x^c". ^ °^ ^ 

symbols of C corresponding to the 4 information symbols " °f '^e MS(m^) codes constructed 

(x^x Xo X ) as pix^ XoJC ) by this illustrative procedure have rate R=(ms+l)/(ms+l+s), 

THe'zSRo for the rate 3/5, MS(1,2) code in accordance 50 and they can advantageously correct erasure bursts of length 

with a third illustrative embodiment of the present invention " e"ard space of g-ms*l with a decodmg delay 

^ ^ ofT«ms+l. 

Specifically, to construct an illustrative MS(ra,s) code in 

7(Z))-(xJ0l xjoj xjfil o,o)+(o, 0, 0, P{xm xjip, 0} )dV accordance with the principles of the present invention, we 

(0, 0, OP{o, Oai[oJ xJojDiP 55 first construct a systematic. MDS, block code, C, with 

parameters (n, k, d)«(2s+k-l, k+s-1, s+1). Note that C can 

FIG, 6 shows an organization of a sequence of encoded always be advantageously constructed by choosing r=[log2 

data packets which have been coded in accordance with a (2s+k-l)] and puncmring a systematic (2*", k+s-1, 2''-k-s+ 

third illustrative embodiment of the present invention, based 2) Reed-Solomon code over GV{T). It is well known to 

on this illustrative MS(1,2) code and on the above ZSRo- those of ordinary skill in the art that Reed-Solomon codes 

'llie figure also shows an illustrative process of decoding a over GF(2'^ can be constructed for all (ni2'', k^n, n-k+1). 

given erasure burst of length 2. As can be seen in the figure, Groups of r bits may be mapped to individual symbols for 

the illustrated erasure buret erases the coded symbols 7[3] ^^is code. If the packet size is not a multiple of r bits, ^me 

padding may be advantageously added at the end of the 

and y [4]. In accordance with the principles of the present packet, 

invention, the decoder advantageously waits until y [5] is Now let P{xo,Xj, . . . be the n-k-s parity check 

received, and then uses the decoding algorithm for C to symbols for C. 'ITien, the ZRSq for the MS(m,s) code is: 
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The functions of the various elements shown in the 

r ^ figures, including functional blocks labeled as "processors" 

y{D) = i;tS"[0], OT^ToJ + or "modules" may be provided through the use of dedicated 

hardware as well as hardware capable of executing software 

L ^ J» rJ^^ » ro-. 5 in association with appropriate software. When provided by 

O''*^^-*' 0,.o[0],o.o ol/y^U ^ processor, the ftinctions may be provided by a single 

dedicated processor, by a single shared processor, or by a 

ko's / *il!if!v ,ilii:!^L\l plurality of individual processors, some of which may be 

lo.o 0' Mo. 0 0, xi;:l^"'[0]. 0. 0,,,.. . o)jDt-'*-» shared. Moreover, expUcit use of the term "processor" or 

jQ "controller" should not be construed to refer exclusively to 
hardware capable of executing software, and may implicitly 

Given the ZSRo shown above, it wUI be obvious to those '^^^^^^^ ^^^out limitations digital signal processor (DSP) 

of ordinary skill in the art that a general class of MS(m,s) hardware, read-only memory (ROM) for stormg software, 

codes can be derived in accordance with the principles of the random access memory (RAM), and non-volatile storage, 

present invention. lUustrative encoder and decoder embodi- 15 ^^^^^ hardware, conventional and/or custom, may also be 

ments of the present invention may then be easily derived included. Similarly, any switches shown in the Figs, are 

therefrom. By examining the above ZSRq and the illustrative conceptual only. Their function may be carried out through 

encoding as shown in FIG. 7, it can specifically be seen that the operation of program logic, through dedicated logic, 

the coded symbol at time i is: through the interaction of program control and dedicated 

^ 20 or ^y^xx manually, the particular technique being 

y[/]-Via /'W*-! W*-2J . . . , ^oI^-^J selectable by the implementer as more specifically under- 

Note that, in particular, the MS(0,s) codes as defined in in the claims hereof any element expressed as a means for 

the above manner, are rate l/(s+l) repetition codes, such as performing a specified function is intended to encompass 

is the delay and duplicate code disclosed in Lou et al. (which performing that function including, for example, 

^, in particular, a 1/2 repetition code). In general, MS codes ^ . ^ combination of circuit elements which performs that 

for rates less than or equal to 1/2 are repetition codes, ^^^^-^^ ^^^^^^^ ^ including, therefore, 

whereas in accordance with vanous illustrative embodi- microcode or the like, combined with appropriate 

ments of the present mvention MS codes for rates ^^^^ ^^^^^^^ ^^^^ the Lction. 

than 1/2 advantageously involve the computation of an • j c j u i. 1 • j - *u ^ . 

appropriate "checLm." Consequently, MS codes generally, 30 "jvention as defined by such clarnis resides in the fact 

can in some sense be viewed as a "generalization" of delay lhat the functionalities provided by the various recited 

and duplicate codes. Note, for example, that the iUustrative "^^^^ ^re combined and brought together m the manner 

rate MS(m,l) codes are rate (m+l)/(m+2) single parity which the claims call for Applicant thus regards any means 

check convolutional codes where the parity check is com- ^h.ch can provide those functionalities as equivalent (within 

puted over diagonals such as in the illustrative 2/3 rate code 35 ^^e meaning of that term as used in 35 U.S.C. 112, paragraph 

described above and shown in HG. 4. 6) to those explicitly shown and described herein. 

Addendum to the Detailed Description ^^at is clauned is: 

It should be noted that all of the preceding discussion 1- ^ method of codmg a sequence of data packets repre- 

merely illustrates the general principles of the invention. It renting a contmuous stream of mformation, each data packet 

will be appreciated that those skilled in the art will be able 40 comprising a set of payload information representative of a 

to devise various other arrangements which, although not segment of said stream of information corresponding 

explicitly described or shown herein, embody the principles l^^^^to, each set of payload information having been simi- 

of the invention and are included within its spirit and scope. »ariy divided into a plurality of corresponding individual 

Furthermore, aU examples and conditional language recited Payload information portions, the method comprising the 

herein are principally intended expressly to be only for 45 ^*^P^ 

pedagogical purposes to aid the reader in understanding the coding a plurality of said data packets, said coding of each 

principles of the invention and the concepts contributed by of said data packets comprising coding said set of 

the inventors to furthering the art, and are to be construed as payload information comprised therein by coding at 

being without limitation to such specifically recited least one of said plurality of individual payload infor- 

examples and conditions. Moreover, all statements herein 50 mation portions thereof; and 

reciting principles, aspects, and embodiments of the coding an additional one of said data packets, said addi- 

invention, as well as specific examples thereof, are intended lional data packet being subsequent in said sequence to 

to encompass both structural and functional equivalents each of said plurality of data packets, said plurality of 

thereof. Additionally, it is intended that such equivalents data packets thereby being previous to said additional 

include both currently known equivalents as well as equiva- 55 data packet, said coding of said additional data packet 

lents developed in the future — i.e., any elements developed comprising coding said set of payload information 

that perfonn the same function, regardless of structure. comprised therein, said coded additional data packet 

Thus, for example, it will be appreciated by those skilled further comprising an added set of payload information 

in the art that the block diagrams herein represent conceptual which provides forward error correcting capability for 

views of illustrative circuitry embodying the principles of 60 said payload information comprised in said plurality of 

the invention. Similariy, it will be appreciated that any flow previous data packets, 

charts, flow diagrams, state transition diagrams, wherein said added set of payload information comprised 

pseudocode, and the like represent various processes which in said coded additional data packet is based on a 

may be substantially represented in computer readable combination of said payload information comprised in 

medium and so executed by a computer or processor, 65 two or more of said previous data packets, and wherein 

whether or not such computer or processor is explicitly said payload information comprised in at least two of 

shown. said previous data packets upon which said added set of 
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payload information is based comprises payload infor- two or more of said previous data packets, and wherein 

matioD from different individual payload information said payload information comprised in at least two of 

portions thereof. said previous data packets upon which said added set of 

2. The method of claim 1 wherein said sets of payload payload information is based comprises payload infor- 
information comprised in each data packet to be coded have 5 mation from different individual payload information 
been similarly divided into m corresponding individual portions thereof, 

payload information portions where m is an integer greater the method of decoding comprising the steps of: 

than one, and wherein said added set of payload information decoding said coded additional one of said data 

comprised in said coded additional data packet comprises a packets, said additional one of said data packets 

checksum of m different individual payload information -^q being subsequent in said sequence to at least one of 

portions of m of said plurality of data packets, said check- said erased data packets, to generate at least one of 

sum based upon a single parity check block code, thereby said individual payload information portions thereof 

resulting in a rate m/(m+l) forward error correcting code. representative of said forward error correcting data; 

3. The method of claim 2 wherein m is equal to 2 and and 

wherein said added set of payload information comprised in -jj reproducing said at least one of said erased data packets 

said coded additional data packet comprises a checksum of based on at least said generated individual payload 

a first individual payload information portion of a first one information portion of said decoded additional one 

of said plurality of data packets and a second individual of said data packets. 

payload information portion of a second one of said plurality 7. The method of claim 6 wherein said sets of payload 

of data packets, thereby resulting in a rate 2/3 forward error 20 information comprised in each coded data packet have been 

correcting code. similarly divided into m corresponding individual payload 

4. The method of claim 1 wherein said sets of payload information portions where m is an integer (greater than one, 
information comprised in each data packet to be coded have and wherein said added set of payload information com- 
been similarly divided into m corresponding individual prised in said coded additional data packet comprises a 
payload information portions where m is an integer greater 25 checksum of m different individual payload information 
than one, and wherein said added set of payload information portions of m of said plurality of data packets, said check- 
comprised in said coded additional data packet comprises a sum based upon a single parity check block code, thereby 
checksum based upon a maximum distance separable block resulting in a rate m/(m+l) forward error correcting code, 
code. 8. The method of claim 7 wherein m is equal to 2 and 

5. The method of claim 1 wherein said added set of 3Q wherein said added set of payload information comprised in 
payload information comprised in said additional one of said said coded additional data packet comprises a checksum of 
data packets is interleaved with one or more other added sets a first individual payload information portion of a first one 
of payload information which are based on data packets of said plurality of data packets and a second individual 
other than said two or more of said previous data packets. payload information portion of a second one of said plurality 

6. A method of decoding a coded sequence of data packets 35 of data packets, thereby resulting in a rate 2/3 forward error 
in response to an erasure of one or more of said data packets correcting code. 

in said sequence, said sequence of data packets representing 9. The method of claim 6 wherein said sets of payload 
a continuous stream of information and including coded information comprised in each coded data packet have been 
forward error correcting data therefor, each coded data similarly divided into m corresponding individual payload 
packet comprising a set of payload information similarly 4Q information portions where m is an integer greater than one, 
divided into a plurality of corresponding individual payload and wherein said added set of payload information corn- 
information portions thereof, two or more of said individual prised in said coded additional data packet comprises a 
payload information portions of each data packet represen- checksum based upon a maximum distance separable block 
tative of a corresponding segment of said stream of infor- code. 

mation and another one or more of said individual payload 45 10. The method of claim 6 wherein said added set of 

portions of each data packet representative of said forward payload information comprised in said additional one of said 

error correcting data, the coded sequence of data packets data packets has been interleaved with one or more other 

having been coded by added sets of payload information which are based on data 

(a) coding a plurahty of said data packets, said coding of packets other than said two or more of said previous data 
each of said data packets comprising coding said set of 50 packets, 

payload information comprised therein by coding at 11. An apparatus for coding a sequence of data packets 

least one of said plurality of individual payload infor- representing a continuous stream of information, each data 

mation portions thereof, and packet comprising a set of payload information represenla- 

(b) coding an additional one of said data packets, said tive of a segment of said stream of information correspond- 
additional data packet being subsequent in said 55 ing thereto, each set of payload information having been 
sequence to each of said plurality of data packets, said similarly divided into a plurality of corresponding individual 
plurality of data packets thereby being previous to said payload information portions, the apparatus comprising: 
additional data packet, said coding of said additional a coder which codes each of a plurality of said data 
data packet comprising coding said set of payload packets by coding said set of payload information 
information comprised therein, said coded additional 60 comprised therein by coding at least one of said plu- 
data packet further comprising an added set of payload rality of individual payload information portions 
information representative of said forward error cor- thereof; and 

reeling data capability for said payload information a coder which codes an additional one of said data 

comprised in said plurality of previous data packets, packets, said additional data packet being subsequent in 

wherein said added set of payload information comprised 65 said sequence to each of said plurality of data packets, 

in said coded additional data packet is based on a said plurality of data packets thereby being previous to 

combination of said payload information comprised in said additional data packet, by coding said set of 
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payload information comprised therein, said coded 
additional data packet further comprising an added set 
of payload information which provides forward error 
correcting capability for said payload information com- 
prised in said plurality of previous data packets, 
wherein said added set of payload information comprised 
in said coded additional data packet is based on a 
combination of said payload information comprised in 
two or more of said previous data packets, and wherein 
said payload information comprised in at least two of 
said previous data packets upon which said added set of 
payload information is based comprises payload infor- 
mation from different individual payload information 
portions thereof. 

12. The apparatus of claim 11 wherein said sets of payload 
information comprised in each data packet to be coded have 
been similarly divided into m corresponding individual 
payload information portions where m is an integer greater 
than one, and wherein said added set of payload information 
comprised in said coded additional data packet comprises a 
checksum of m different individual payload information 
portions of m of said plurality of data packets, said check- 
sum based upon a single parity check block code, thereby 
resulting in a rate m/(m+l) forward error correcting code. 

13. ITie apparatus of claim 12 wherein m is equal to 2 and 
wherein said added set of payload information comprised in 
said coded additional data packet comprises a checksum of 
a first individual payload information portion of a first one 
of said plurality of data packets and a second individual 
payload information portion of a second one of said plurality 
of data packets, thereby resulting in a rate 2/3 forward error 
correcting code. 

14. The apparatus of claim 11 wherein said sets of payload 
information comprised in each data packet to be coded have 
been similarly divided into m corresponding individual 
payload information portions where ra is an integer greater 
than one, and wherein said added set of payload information 
comprised in said coded additional data packet comprises a 
checksum based upon a maximum distance separable block 
code. 

15. The apparatus of claim 11 wherein said added set of 
payload information comprised in said additional one of said 
data packets is interleaved with one or more other added sets 
of payload information which are based on data packets 
other than said two or more of said previous data packets. 

16. An apparatus for decoding a coded sequence of data 
packets in response to an erasure of one or more of said data 
packets in said sequence, said sequence of data packets 
representing a continuous stream of information and includ- 
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(b) a coder which codes an additional one of said data 
packets, said additional data packet being subsequent in 
said sequence to each of said plurality of data packets, 
said plurality of data packets thereby being previous to 
said additional data packet, by coding said set of 
payload information comprised therein, said coded 
additional data packet further comprising an added set 
of payload information representative of said forward 
error correcting data capability for said payload infor- 
mation comprised in said plurality of previous data 
packets, 

wherein said added set of payload information comprised 
in said coded additional data packet is based on a 
combination of said payload information comprised in 
two or more of said previous data packets, and wherein 
said payload information comprised in at least two of 
said previous data packets upon which said added set of 
payload information is based comprises payload infor- 
mation from different individual payload information 
portions thereof, 

the apparatus for decoding comprising a decoder which 
decodes said coded additional one of said data packets, 
said additional one of said data packets being subse- 
quent in said sequence to at least one of said erased data 
packets, to generate at least one of said individual 
payload information portions thereof representative of 
said forward error correcting data, and which repro- 
duces said at least one of said erased data packets based 
on at least said generated individual payload informa- 
tion portion of said decoded additional one of said data 
packets. 

17. The apparatus of claim 16 wherein said sets of payload 
information comprised in each coded data packet have been 
similarly divided into m corresponding individual payload 
information portions where m is an integer greater than one, 
and wherein said added set of payload information com- 
prised in said coded additional data packet comprises a 
checksum of m different individual payload information 
portions of m of said plurality of data packets, said check- 
sum based upon a single parity check block code, thereby 
resulting in a rate m/(m+l) forward error correcting code. 

18. The apparatus of claim 17 wherein m is equal to 2 and 
wherein said added set of payload information comprised in 
said coded additional data packet comprises a checksum of 
a first individual payload information portion of a first one 
of said plurality of data packets and a second individual 
payload information portion of a second one of said plurality 
of data packets, thereby resulting in a rate 2/3 forward error 
correcting code. 

19. The apparatus of claim 16 wherein said sets of payload 



ing coded forward error correcting data therefor, each coded 50 information comprised in each coded data packet have been 
data packet comprising a set of payload information simi- similarly divided into m corresponding individual payload 
larly divided into a plurality of corresponding individual information portions where m is an integer greater than one, 
payload information portions thereof, two or more of said and wherein said added set of payload information corn- 
individual payload information portions of each data packet prised in said coded additional data packet comprises a 
representative of a corresponding segment of said stream of 55 checksum based upon a maximum distance separable block 
information and another one or more of said individual 
payload portions of each data packet representative of said 
forward error correcting data, the coded sequence of data 
packets having been coded by an apparatus comprising 
(a) a coder which codes each of a plurality of said data 
packets by coding said set of payload information 
comprised therein by coding at least one of said plu- 
rality of individual payload information portions 
thereof, and 
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code. 

20. The apparatus of claim 16 wherein said added set of 
payload information comprised in said additional one of said 
data packets has been interleaved with one or more other 
added sets of payload information which are based on data 
packets other than said two or more of said previous data 
packets. 
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